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Apparatus and method for performing orthogonal polarized spectral imaging (OPSI) 



The present invention relates to a method and system for detection of objects 
below the surface of diffuse scattering media, and in particular blood capillaries, in organs, 
such as the skin of human beings, using Orthogonal Polarized Spectral Imaging (OPSI), as 
described by the preamble of independent patent claim 1 . 



It is a well know tendency in all areas of medical care, to provide methods and 
systems mat allow for a minimally or non-invasive treatment of patients amongst others to 
reduce bom risks, and stress for the patient In line with this tendency, projects have been 

10 created to provide methods of non-invasive blood analysis. In the Non-Invasive Blood 

Analysis one of the possibilities is to measure the concentration of various analytes in blood 
in vivo by means of confocal Raman spectroscopy. 

To achieve a Raman signal from blood instead of skin, the blood capillaries 
near the skin surface have to be visualized and the Raman detection volume has to be aimed 

15 at one of these capillaries. Blood capillaries close to the skin surface have a diameter of 5 to 
15 um. Due to confocal detection; the source of the collected Raman signal is well confined 
in all three dimensions in a spot of <5x5xl0 um 3 . This allows collecting a Raman signal from 
blood without a background signal from skin tissue if the focus is located in a blood 
capillary. 

20 In this respect, a simple, cheap, and robust method to visualize blood vessels 

close to the surface of organs is the Orthogonal polarized spectral imaging (OPSI). Medical 
applications of Orthogonal Polarization Spectral Imaging can for example be taken from WO 
01/22741, which is incorporated by reference herein. In a recent test it was shown that it is 
also possible to use OPSI to visualize blood capillaries in the human skin. In OPSI polarized 

25 light is incident on the skin through a polarizing beam splitter. Part of the light reflects 

directly from the surface (specular reflection). Another part penetrates into the skin where it 
scatters one or more times before it is absorbed or is re-emitted from the skin surface (diffuse 
reflection). In any of these scattering events there is a chance that the polarization of the 
incident light is changed. Light that is directly reflected or penetrates only slightly into the 
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skin will scatter only one or a few times before it is re-emitted, and will mostly retain its 
initial polarization. On the other hand, light that penetrates more deeply into the skin 
undergoes multiple scattering events and is depolarized before re-emitted back towards the 
surface. When looking at the subject through a second polarizer, oriented precisely 
orthogonal to that of the first polarizer, light reflected from the surface or the upper parts of 
the skin is largely suppressed, whereas light that has penetrated deeper into the skin is mostly 
detected. As a result the image looks as if it were back-ffluminated Because wavelengths 
below 590 nm are strongly absorbed by blood, the blood vessels appear dark in the OPSI 
image, though. 

The reliability of a measured concentration of analytes in blood directly 
depends on the ability to direct the Raman detection volume inside a blood vessel. However, 
even though Orthogonal polarized spectral imaging (OPSI) is a method to detect blood 
capillaries in human skin, it is essentially a 2-dimensional technique, whereas a 
3-dimensional image would be desirable to be able to exactly aim the Raman detection 
volume. While the lateral resolution of OPSI is of the same order of magnitude as the Raman 
technique, OPSI hardly provides any depth information. The only depth discrimination 
available is caused by the depth of focus of the imaging objective. As the capillary moves out 
of the focal plane, it is blurred Using the sharpness of the imaged blood vessels to determine 
the depth of the vessels has several disadvantages: it is not very precise; when the capillary is 
seen as blurred it is not a priori clear if the capillary is above or below the focal plane; when 
the capillary is seen as blurred it is not a priori clear what the distance is between the blood 
capillary and the focal plane. An additional complication is that even in-focus images of 
blood capillaries are blurred because of fight scattering in the skin tissue above the blood 
capillary. The lack of reliable depth information makes it difficult to aim the Raman laser at a 
blood vessel. 



Accordingly, it is an object of the present invention to provide a method and 
system for detection of objects below the surface of diffuse scattering media, and in 
particular blood capillaries, in organs, such as the skin of human beings, using Orthogonal 
Polarized Spectral Imaging (OPSI), which allows a more precise localization of the objects, 
and in particular capillaries in the human skin. 
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This object is solved by the features according to the independent claims, 
wherein the features as contained in the dependent claims describe preferred, and useful 
embodiments. 

Provided is a method for detection of objects below the surface of diffuse 
scattering media, and in particular blood capillaries in organs, such as the skin of human 
beings, using Orthogonal Polarized Spectral Imaging (OPSI), according to the invention 
comprising the steps of, imaging the object in question under at least two different angles, to 
obtain a shift of position in the imaging plane; and subsequently comparing relative shifts of 
objects in the two images to obtain coordinates of the imaged objects with respect to the focal 
plane. 

Accordingly, it is proposed to use a stereoscopic variety of OPSI to obtain 
depth information, wherein the blood capillaries are imaged under different angles, resulting 
in a shift of position in the image plane. From direction of the shift it can be determined if the 
blood capillary is above or below the focal plane, whereas the distance between the blood 
capillary and the focal plane can be calculated from the size of the shift. Stereoscopy is a 
well-known technique for conventional microscopy. The object is imaged under different 
angles and depth information is obtained by comparing relative shifts of objects in the two 
images. The human brain does this automatically when the eyes separately view the two 
images. Image analysis algorithms are also able to extract this information and quantify it 

Modern stereomicroscopes are based on two different concepts. In the 
so-called Greenough design two identical objectives are used under different angels. In the 
so-called telescopic design or common objective design, two partial microscope systems are 
arranged in parallel with each other and use the same main objective. In a preferred 
embodiment of the invention the angle between the light paths of the at least two images is 

chosen to be between 10 and 30 degrees. 

Furthermore, for non-invasive blood analysis using confocal Raman 
spectroscopy, a relatively high magnification and high numerical aperture (NA) objective 
with a short working distance to focus the Raman laser and to collect the Raman signal is 
used For ease of construction and alignment and because of space and cost limitations it is 
advantageous to use the same objective for OPSI. There are basically two ways to obtain a 
stereoscopic image using a single objective: iUuminating only a part of the objective with a 
parallel beam or iUuminating the whole objective under a certain angle. 

In OPSI light with a wavelength of 540 to 580 nm is used for detecting blood 
vessels in human skin. For OPSI imaging a lateral resolution of 1 urn is preferable, which can 
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be achieved by using a NA of 0.35. The relation between the depth resolution Az and the 
stereoscopic angle a is given by 



Tana=0,5Ax / Az. 

Where Ax is Ihe lateral resolution of the system. The factor 0.5 arises because imaging from 

the left (-a) and from the right (+<x) are compared Some typical values are given in ihe table 
below: 



Depth resolution (jam) 


Stereoscopic angle 
(degrees) 


1 


27 

♦ 


2 " 


14 


5 


6 



For a NA = 0.9 objective the maximum angle at which light can travel in 
object space is 64°. For a lateral resolution of 1 um, an effective NA of 0.3 5 an angle of 21° 
is required. Therefore, the maximum stereoscopic angle (neglecting other limitations like 
geometric constraints in image space) is 43°. For this angle the highest depth resolution of 
0.54 um is achieved 

Furthermore, an apparatus for stereoscopic Orthogonal Polarized Scattering 
Imaging (OPSI) is provided, for imaging objects below the surface of diffuse scattering 
media, and in particular blood capillaries, in organs, such as the skin of human beings, 
comprising at least a light source providing polarized light, an imaging device such as' a 
CCD-camera, a beam splitter, which preferably is a polarized beam splitter, a focusing device 
such as an objective, or a mirror, and means for imaging the object in two different imaging 
angles, subsequently or at the same time. The light source preferably is arranged to ffluminate 
a diffuse scattering medium, which upon this mumination Ruminates the object with 
depolarized light The means for imaging the object can be formed by two objectives having 
different imaging angles, or by a single main objective, and a scanning mirror for shifting the 
imaging beam on its path from the polarizing beam splitter to the imaging device. The two 
imaging angles preferably differ by 10 to 30 degrees. 

Furthermore, separate imaging devices can be provided for each image, or, as 
an alternative, a shutter for alternating transmission of one of the two images is provided,' 
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which is preferably located between the polarizing beam splitter and the imaging device, and 
can be embodied as a rotating aperture shutter, a liquid crystal cell shutter, or any other 
suitable means. The imaging device can for example be a CCD or CMOS camera. 

The apparatus can furfoer comprise a data processor for deterrmning a position 
of the object, wherein the position includes at least information about the z-axis, parallel to 
the optical axis. 

The apparatus may further comprise a spectroscopic analysis system having a 
spectroscopic light source which may be laser for providing a spectroscopic light beam, a 
spectroscopic light beam positioning device for directing the spectroscopic light beam to the 
object in dependence of foe position of the object determined by foe data processor. The 
spectroscopic analysis system may be identical to that described in WO 02/057759. 



Further features and advantages of foe present invention will become more 
apparent for someone skilled in the art when reading foe following description of preferred 
embodiments in connection with foe annexed figures, in which: 

Fig. 1 shows a schematic representation of a setup for OPSI; 

Fig. 2a shows a schematic representation of foe exit pupil of foe imaging 
objective with OPSI light paths using parallel beams in a top view; 

Fig. 2b shows a side view of fig. 2a; 

Fig. 3 shows an embodiment of foe OPSI setup using parallel imaging beams; 
Fig. 4 shows an embodiment using foe same objective and tilted imaging 

beams; and 

Fig. 5 shows foe schematic position of blood vessels in an image as foe 
function of viewing angle and position relative to foe focal plane. 



In figure 1 a schematic representation of a typical setup for OPSI is shown, 
comprising a light source 1, such as a lamp, a laser, an LED, etc., a condenser 2, diaphragi 
3, a color filter 4, a polarizer 5, a polarizing beam splitter 6, and an objective 7. Furthermore, 
in Fig. 1 a skin 8 consisting of (a) epidermis, and (b) dermis is shown, together with blood 
capillaries 9. Finally, an analyzer 10 is shown, wherein polarization is effected perpendicular 
to polarizer 4, a lens 11, and a CCD camera 12. 
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In figure 2a the top view of an exit pupil 13 of lie imaging objective with 
OPSI light paths using parallel beams 14, 1 5 is shown. In a non-invasive blood analyzer an 
objective with a NA of 0.9 is used. For OPSI imaging a lateral resolution of 1 or 2 um is 
required, which can be achieved by using an objective with a NA of 0.35. Because the NA 
required for OPSI (0.35) is much smaller than the NA available (0.9), it is possible to use 
only a traction of Ihe pupil 13 area for imaging. The different stereoscopic angles can be 
achieved by ffluminating different area's of me pupil 13. Using parallel beams 14, 15, the 
blood vessels 9 in the focal plane are imaged on the same position if observed under both 
stereoscopic angles. Vessels 9 that tie before or behind the focal plane have a different 
position in both images. A possible embodiment is shown in figure 3. 

The position of the imaging beam in Ihe objective pupil 13 can be shifted by 
using a scanning (rotating) mirror 16 and a relaying lens 17. If the distance between this lens 
17 and the scanning rnirror 16 equals the focal distance of the relaying lens 17, a tilt of the 
mirror 16 results in a parallel displacement of the imaging beam in 1he objective pupil 13. 
The distance between Ihe objective pupil 13 and the blood vessel 9 is equal to the focal 
distance of the objective pupil 13 (corrected for the refractive index of human skin). 

An alternative embodiment is shown in figure, 4, whereby the same elements 
as in the previous figures have been provided with corresponding reference signs. A 
polarizing beam splitter 6 separates the light paths of the fflumination system and the imaging 
system The imaging system contains a scanning mirror 16 and a relaying lens 17 such that 
the pivot point on the scanning mirror 16 is imaged on the center of the objective lens 13. An 
imaging lens finally is used to image the focal plane of the objective lens 13 onto a CCD 
camera. 

As the scanning mirror 16 performs a wobbling motion, the OPSI image 
moves. Objects that are in front of or above the focal plane will move less than objects 
behind or below me focal plane. Objects that are in the focal plane will move over a distance 
Mf tan p, where M is the magnification factor of the OPSI system, f is Ihe focal length of the 
objective, and 0 is the viewing angle through the microscope objective. 0 is related to the 
scanning angle <y of scanning mirror 1 6 through tan 0 = (A/B ) tan 2 a, where A is the 
distance from the scanning mirror 16 to the relaying lens 17 and B is me distance from the 
relaying lens 17 to the objective lens 13. 

Objects that are at a distance delta above the focal plane will move over a 
distance that is slightly smaller, M (f - 8) tan 0, whereas objects at a distance 8 below the 
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focal plane will move over a distance that is slightly larger, M (f + 8) tan (5, please refer to 
figure 5. 

In figure 5 the schematic position of blood vessels 1 8 is shown, The three 
blood vessels 1 8a, 18b, 18c shown in figure 5 all overlap in the case of p = 0, but their 
5 projections on the focal plane all have different displacements for £ ^ 0. 

Besides the embodiments described above, other embodiments are possible, as 
for example use of a single imaging device which includes a replacement for the scanning 
mirror by a rotating wedge, or by two shifting wedges. It is also possible to use 2 imaging 
devices looking at different angles through the objective. This has the advantage that there 
10 are no moving parts and that the images firom both sides can be detected simultaneously. 
From the obtained images, the amount of de-focus can be determined using a correlation 
function or by subtracting the two images. 

Provided is a method and an apparatus for detection of objects below the surface of 
diffuse scattering media, and in particular blood capillaries, in organs, such as the skin of 
1 5 human beings, using Orthogonal Polarized Spectral Imaging (OPSI), according to the 

invention comprising the steps of, imaging the object in question under at least two different 
angles, to obtain a shift of position in the imaging plane; and subsequently comparing relative 
shifts of objects in the two images to obtain coordinates of the imaged objects with respect to 
the organ surface. 

20 It should be noted that the above-mentioned embodiments illustrate rather than 

limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of other elements or steps than those listed 

25 in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. 
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CLAIMS: 



1 . Apparatus for performing Orthogonal Polarized Spectral Imaging (OPSI) for 
imaging objects below the surface of diffuse scattering media, and in particular blood 
capillaries, in organs, such as the skin of human beings, comprising amongst others at least a 
light source (1) for providing polarized light, an imaging device (12), a beam splitter (6), an 
focusing device (7), and means for imaging the object in two different imaging angles. 

2. Apparatus according to claim 1, characterized in that the means for imaging 
the object is formed by two objectives having different imaging angles. 

3 Apparatus according to claim 1, characterized in that the means for imaging 
the object is formed by a single main objective (7), and a scanning mirror (16), a rotating 
wedge or 2 shifting wedges for shifting the imaging beam on its path from the polarizing 
beam splitter (6) to the imaging device (12). 

4 Apparatus according to claim 1, characterized in that separate imaging devices 
(12) are provided for each image. 

5 Apparatus according to claim 4, characterized in that a shutter for alternating 
transmission of one of the two images is provided. 

6, Apparatus according to claim 5, characterized in that the shutter is located 

between the polarizing beam splitter (6) and the imaging device (12). 

7 b Apparatus according to claim 5, characterized in that the shutter is a rotating 

aperture shutter. 



g_ Apparatus according to claim 5, characterized in that the shutter is a liquid 

crystal cell shutter. 
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9. Apparatus according to claim 1 , characterized in that the two imaging angl 

differ by 10 to 30 degrees. 
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10. Apparatus according to claim 1, characterized in that the imaging devices 

5 CCD-cameras. 



are 



11. 



Apparatus according to claim 1, characterized in that the imaging devices 



are 



CMOS-sensors. 



10 



15 



20 



12. Apparatus according to claim 1, characterized in further comprising a data 
processor for determining a position of the object, the position including at least information 
about the z-axis, which is parallel to the optical axis. 

13. Apparatus according to claim 12, characterized in further comprising a 
spectroscopic analysis system, with a spectroscopic light source, a spectroscopic light beam 
positioning device for directing the spectroscopic light beam to the object in dependence of 
the position of the object determined by the data processor. 

14. A method for detection of objects below the surface of diffuse scattering 
media, and in particular blood capillaries, in organs, such as the skin of human beings, using 
Orthogonal Polarized Spectral Imaging (OPS1), comprising the steps of: 

imaging the object in question under at least two different angles, to obtain a 
shift of position in the imaging plane; and 

comparing relative shifts of objects in the two images to obtain coordinates of 
the imaged objects with respect to the organ surface. 

1 5. Method according to claim 14, characterized in that based on the direction of 
shift it is determined whether the imaged object is above or below the focal plane. 



30 16 - Method according to claim 14, characterized in that based on the size of the 

shift, the distance between the object and the focal plane is calculated. 

17. Method according to claim 1, characterized in that the imaging angle is chosen 

to be between 10 and 30 degrees. 



25 
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1 8. Method according to claim 14, characterized in that for imaging of the object, 
a single objective (7) is used 

19. Method according to claim 1 8, characterized in that to obtain the at least two 
images, part of the objective (7) is muminated with a parallel beam. 



20. Method according to claim 1 8, characterized in that to obtain the at least two 

images, the whole objective (7) is illuminated under a defined angle. 
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ABSTRACT: 



Provided is a method and an apparatus for detection of objects below the 
surface of diffuse scattering media, and in particular blood capillaries, in organs, such as the 
skin of human beings, using Orthogonal Polarized Spectral Imaging (OPSI), according to the 
invention comprising the steps of, imaging the object in question under at least two different 
angles, to obtain a shift of position in the imaging plane; and subsequently comparing relative 
shifts of objects in the two images to obtain coordinates of the imaged objects with respect to 
the organ surface. 



Fig. 4 
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